A Survey on Deep Multi-modal Learning for Body Language Recognition and Generation

Body language (BL) refers to the non-verbal communication expressed through physical movements, gestures, facial expressions, and postures. It is a form of communication that conveys information, emotions, attitudes, and intentions without the use of spoken or written words. It plays a crucial role in interpersonal interactions and can complement or even override verbal communication. Deep multi-modal learning techniques have shown promise in understanding and analyzing these diverse aspects of BL. The survey emphasizes their applications to BL generation and recognition. Several common BLs are considered i.e., Sign Language (SL), Cued Speech (CS), Co-speech (CoS), and Talking Head (TH), and we have conducted an analysis and established the connections among these four BL for the first time. Their generation and recognition often involve multi-modal approaches. Benchmark datasets for BL research are well collected and organized, along with the evaluation of SOTA methods on these datasets. The survey highlights challenges such as limited labeled data, multi-modal learning, and the need for domain adaptation to generalize models to unseen speakers or languages. Future research directions are presented, including exploring self-supervised learning techniques, integrating contextual information from other modalities, and exploiting large-scale pre-trained multi-modal models. In summary, this survey paper provides a comprehensive understanding of deep multi-modal learning for various BL generations and recognitions for the first time. By analyzing advancements, challenges, and future directions, it serves as a valuable resource for researchers and practitioners in advancing this field. n addition, we maintain a continuously updated paper list for deep multi-modal learning for BL recognition and generation: https://github.com/wentaoL86/awesome-body-language

An Improvement of Shotgun Proteomics Analysis by Adding Next-Generation Sequencing Transcriptome Data in Orange

BACKGROUND: Shotgun proteomics data analysis usually relies on database search. Because commonly employed protein sequence databases of most species do not contain sufficient protein information, the application of shotgun proteomics to the research of protein sequence profile remains a big challenge, especially to the species whose genome has not been sequenced yet. METHODOLOGY/PRINCIPAL FINDINGS: In this paper, we present a workflow with integrated database to partly address this problem. First, we downloaded the homologous species database. Next, we identified the transcriptome of the sample, created a protein sequence database based on the transcriptome data, and integtrated it with homologous species database. Lastly, we developed a workflow for identifying peptides simultaneously from shotgun proteomics data. CONCLUSIONS/SIGNIFICANCE: We used datasets from orange leaves samples to demonstrate our workflow. The results showed that the integrated database had great advantage on orange shotgun proteomics data analysis compared to the homologous species database, an 18.5% increase in number of proteins identification

Droplet-like Fermi surfaces in the anti-ferromagnetic phase of EuFe2_2As2_2, an Fe-pnictide superconductor parent compound

Using angle resolved photoemission it is shown that the low lying electronic states of the iron pnictide parent compound EuFe$_2$As$_2$ are strongly modified in the magnetically ordered, low temperature, orthorhombic state compared to the tetragonal, paramagnetic case above the spin density wave transition temperature. Back-folded bands, reflected in the orthorhombic/ anti-ferromagnetic Brillouin zone boundary hybridize strongly with the non-folded states, leading to the opening of energy gaps. As a direct consequence, the large Fermi surfaces of the tetragonal phase fragment, the low temperature Fermi surface being comprised of small droplets, built up of electron and hole-like sections. These high resolution ARPES data are therefore in keeping with quantum oscillation and optical data from other undoped pnictide parent compounds.Comment: 4 figures, 6 page

Willingness to Accept HIV Pre-Exposure Prophylaxis among Chinese Men Who Have Sex with Men

OBJECTIVE: We investigated the awareness and acceptability of pre-exposure prophylaxis (PrEP) among men who have sex with men (MSM) and potential predicting factors. METHODS: This study was conducted among MSM in Beijing, China. Study participants, randomly selected from an MSM cohort, completed a structured questionnaire, and provided their blood samples to test for HIV infection and syphilis. Univariate logistic regression analyses were performed to evaluate the factors associated with willingness to accept (WTA) PrEP. Factors independently associated with willingness to accept were identified by entering variables into stepwise logistic regression analysis. RESULTS: A total of 152 MSM completed the survey; 11.2% had ever heard of PrEP and 67.8% were willing to accept it. Univariate analysis showed that age, years of education, consistent condom use in the past 6 months, heterosexual behavior in the past 6 months, having ever heard of PrEP and the side effects of antiretroviral drugs, and worry about antiretroviral drugs cost were significantly associated with willingness to accept PrEP. In the multivariate logistic regression model, only consistent condom use in the past 6 months (odds ratio [OR]: 0.31; 95% confidence interval [CI]: 0.13-0.70) and having ever heard of the side effects of antiretroviral drugs (OR: 0.30; 95% CI: 0.14-0.67) were independently associated with willingness to accept PrEP. CONCLUSIONS: The awareness of PrEP in the MSM population was low. Sexual behavioral characteristics and knowledge about ART drugs may have effects on willingness to accept PrEP. Comprehensive prevention strategies should be recommended in the MSM community

Immunogenicity and safety of purified vero cell rabies vaccine (PVRV) produced by Liaoning Cheng Da Co. under Zagreb 2-1-1 or 5-dose Essen regimen in Chinese adults aged 50 and above

Background: Two kinds of regimens (2-1-1 and 1-1-1-1-1) can be selected after Zagreb regimen(2-1-1)of PVRV was officially approved in Beijing in January 2015. Up to now, the subjects for most studies about the comparison between Zagreb and Essen regimen are under 50 y old, rarely at and above. Aging of the immune system may result in decreasing efficacy of vaccination, especially for adults aged above 65–70 y. This study compared the safety and immunogenicity of the Zagreb and Essen regimen in Chinese adults aged 50 and above with the goal to provide a supplemental data for this age group. Methods: A total of 114 cases were divided into 2 groups randomly, received PVRV under the Zagreb and Essen regimens respectively. Serum samples were collected at D0, D7, D14, D42, D180 and D365 to determine the rabies serum neutralizing antibody by rapid fluorescent focus inhibition test (RFFIT). Safety analyses were made by comparing the AEs in day-3, day-7, and day-(7 + 21) in Zagreb or day-(7 + 28) in Essen by gender and age cohorts. Results: 617 blood samples were obtained. Two groups showed similar immunogenicity, the neutralizing antibody titer of all subjects at D14 and D42 showed >0.5 IU/ml. Under the same regimen, Subjects ≥65 y had lower GMC than those who <65 years from D7 to D365 within 2 groups. This difference was significantly shown on D7, D14, D180 in Zagreb group, and on D180 in Essen group (t = 2.38, p = 0.02; t = 3.78, p < 0.001; t = 2.30, p = 0.03; t = 4.42, p < 0.001). Subjects<65 years had higher seroconversion rate compared to ≥65 y on D7, D180 and D365 in both 2 groups, this difference was also significantly shown on D180, D365 in Zagreb group and on D180 in Essen group (χ2 = 20.66, p < 0.001; χ2 = 6.56, p = 0.02; χ2 = 10.96, p = 0.002). Two regimens all showed favorable performances with mildly or common adverse events (AEs). The incidence of local AEs after 3 d in Essen group was higher than Zagreb group (χ2 = 9.69, p = 0.002). The most common local AE was pain, the incidences (8.8%) in Zagreb group was higher than Essen group (8.4%, χ2 = 5.12, p = 0.02). All AEs for Zagreb group and 52.3% of AEs for Essen group occurred during the first 72 hours. During the first 72 hours, subjects aged <65 in Zagreb group (16.26%) had higher incidences of AEs than Essen group (8.57%, χ2 = 4.54, p = 0.03), males in Zagreb group (16.05%) had higher incidence of AEs than Essen group (5.71%, χ2 = 5.34, p = 0.02). The incidences of AEs close in during the first 7 d. Conclusion: The Zagreb and Essen regimens demonstrated the similar safety and efficacy of PVRV in Chinese adults aged 50 and above. People ≥65 y showed reduced immune response to both regimens. More AEs for the Zagreb regimen were observed within the first 72 hours, especially for male and people < 65 y